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Intrinsically noisy mechanisms drive most physical, biological and economic phenomena, from 
stock pricing to phenotypic variability. Frequently, the system's state influences the driving noise 
intensity, as, for example, the actual value of a commodity may alter its volatility or the concen- 
tration of gene products may regulate their expression. All these phenomena are often modeled 
using stochastic differential equations (SDEs). However, an SDE is not sufficient to fully describe 
a noisy system with a multiplicative feedback, because it can be interpreted according to various 
conventions - in particular, Ito calculus and Stratonovitch calculus -, each of which leads to a quali- 
tatively different solution. Which convention to adopt must be determined case by case on the basis 
of the available experimental data; for example, the SDE describing electrical circuits driven by a 
noise are known to obey Stratonovich calculus. Once such an SDE-convention pair is determined, 
it c an be employed to predict the system's behavior under new conditions. Here, we experimen- 
tally demonstrate that the convention for a given physical system may actually vary under varying 
operational conditions. We show that, under certain conditions, a noisy electric circuit shifts to 
obey Ito calculus, which may dramatically alter the system's long term stability. We track such 
Stratonovich-to-Ito transition to the underlying dynamics of the system and, in particular, to the 
ratio between the driving noise correlation time and the feedback delay time. We briefly discuss 
ramifications of our conclusions for biology and economics: the possibility of similar transitions and 
their dramatic consequences should be recognized and accounted for where SDEs are employed to 
predict the evolution of complex phenomena. 

I. INTRODUCTION 

Mathematical models arc often employed to predict the behavior and evolution of complex physical, chemical, 
biological and economic phenomena. Often more realistic mathematical models can be obtained by allowing for some 
randomness In a dynamical system, for example, this randomness can be introduced by adding a noisy driving 
term, where a noise Xt drives the evolution of the state yt of the dynamical system [Fig. [Ha)]. Similar models have 
been employed to describe a wide range of phenomena, from thermal fluctuations of microscopic objects and the 
evolution of stock prices 0] to heterogeneous response of biological systems to stimuli [|| and stochasticity in gene 
expression 

Intrinsically noisy phenomena are often modeled using stochastic differential equations (SDEs) An SDE is 
obtained by adding some randomness to a deterministic dynamical system described by an ordinary differential 
equation (ODE) @. A typical SDE has the form: 

dy t = G(y t )dt + adW t , (1) 

where G(y) is a function representing the deterministic response of the system, Wt is a Wiener process representing 
the stochastic driving, and a is a scaling constant representing the intensity of the noise. Clearly, the term a dWt 
is a mathematical model of the physical noise Xt dt. In particular, any real process has always a correlation time 
r > 0, while dWt is strictly uncorrelated, i.e. r = 0; therefore, the smaller the r of a real process, the better it is 
approximated by dWt Q. We remark that Eq. ([1]) has a unique solution with a given initial condition yo. This 
solution satisfies the integral equation y t = y + J Q G(y s )ds + aW t 

In many real phenomena, the system's state further influences the driving noise intensity [Fig. Hfb)]; for example, 
the volatility of a stock price may be altered by its actual value Q or gene expression may be regulated by the 
concentration of its products Q. This multiplicative feedback F(y) leads us to consider an SDE with multiplicative 
noise: 



dy t = G{yt)dt + (xF(y t )dWt. 



(2) 
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Unlike Eq. (JIJ , the integration of Eq. ([2]) presents some difficulties because W* is a function of unbounded variation 
The stochastic integral J Q f(yt) 2n dW t = lim n _ s . 00 J2n=o f(yt„)AWt n , where t n = ™±2iT and a e [0,1], leads to 
different values for each choice of a jjj, lToj [. Common choices arc: the /to integral with a = [llj ; the Stratonovitch 
integral with a = 0.5 [l2| : and the anti-Ito or isothermal integral with a = 1 [la ]. Alternative values of a may entail 
dramatic consequences; for example, a Malthusian population growth model with a noisy growth rate can lead either 
to extinction, if solved with a = 0, or to exponential growth, if solved with a = 0.5 [l], Section 5.1]. Ther efore, a 
complete model is defined by the SDEs and the relative convention, which must be determined on the basis of the 



available experimental data |14| . Various preferences regarding the appropriate choice of a have emerged in various 



fields in which SDEs have been fruitfully applied. For example, a — is typically employed in economics [l| and 
biology [TH, because of its property of "not looking into the future," referring to the fact that, when the integral 
is approximated by a sum, the first point of each interval is used, a = 0.5 naturally emerges in real systems with 
non- white noise, i.e. r > 0, e.g. the SDEs describing electrical circuits driven by a multiplicative noise as a 
consequence of the Wong-Zakai theorem, which states that, if the Wiener process is substituted by smooth process 
with r — > 0, the resulting SDE obeys the Stratonovich calculus [I3|- Finally, a = 1 naturally emerges in physical 
systems in equilibrium with a heat bath fl8U20j . Other values of a have also been theoretically proposed (2l| - [23| . 
Clearly, from the modelling perspective the choice of the appropriate SDEs-convcntion pair is of critical importance, 
especially when the model is subsequently employed to predict the system's behavior under new conditions. 

In this article, we experimentally demonstrate that the convention for a given physical system can actually vary 
under changing operational conditions. We show that the equation describing the behavior of an electric circuit with 
multiplicative noise, which usually obeys the Stratonovitch convention (a = 0.5) (ltjj . crosses over to obey the Ito 
convention (a = 0), as certain parameters of the dynamical systems arc changed. This transition is continuous, going 
through all intermediate values of a and we relate it by an explicit formula to the ratio between r and the feedback 
delay time 5, which is always present in any real system. Similar transitions have the potential of dramatically altering 
a system's long term behavior and, therefore, we argue their possibility should be taken into account in the modelling 
of systems with SDEs, which are widely employed in economics, biology and physics. 



II. SYSTEM WITHOUT FEEDBACK 



A system near an equilibrium is often described as a harmonic oscillator, where a restoring force brings the system 
back towards the equilibrium. Such harmonic oscillators are widely employed to describe the behavior of systems near 
their equilibria, from the swinging of pendula to the vibrations of atoms in crystals. In this work, as a paradigmatic 
experimental realization of an ovcrdamped harmonic oscillator, we consider an RC electric circuit with resistance 
R = 1 kf2 and capacitance C = 100 nF; x t is the driving voltage (applied on the series RC) and yt the output voltage 
(measured on C) [Fig. |2fa)]. In order to approximate a Wiener process, we will always use a driving noise with a 
correlation time much shorter than the typical relaxation time of the circuit, i.e. r -C RC = 100 (is. A detailed 
description of the circuit is given in the methods section. The output voltage y experiences an elastic restoring force 
with elastic constant k = 1/RC towards the y = equilibrium state. 

In order to understand qualitatively the behavior of our system, in Fig. [2Jb) we consider the evolution of yt for 
a given initial condition yo and r = 1.1 /is. The dashed line illustrates a sample trajectory for yo = — 250 mV: 
at the beginning y t decays towards the equilibrium y = mV and, afterwards, oscillates around the equilibrium, 
clearly demonstrating its stochastic nature. Averaging several such trajectories, we obtain solid lines corresponding 
to different yo, which clearly show that the average trajectory moves towards the equilibrium regardless of yo. 

The relevant SDE is Eq. (1) with G(y) = —ky and a proportional to the intensity of the noise, i.e.: 

dy t = -ky t dt + a dW t , (3) 

where we remark that, since a is constant, the choice of a does not affect the solution and, therefore, the convention 
can be left undetermined. 

In a very general sense, a system described by an SDE can be characterized by its stochastic diffusion S(y) and its 
drift D(y) [lj]. Letting the system evolve from an initial state y for an infinitesimal time-step, S(y) is proportional 
to the variance of the system's state change [inset in Fig. |2{c)] and D(y) to its average [inset in Fig. [UJd)]. S(y) and 
D(y) can be obtained from an experimental discrete time-series {yo, ...,yN-i} sampling the output signal at intervals 
At as 

S{y) = ^ t ({y n +i-y n ) 2 \y n = y) (4) 

and 

D (y) = 4t (vn+i - y n \y n = v)- (5) 
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Eqs. (dJ and §5§ arc strictly true in the limit At — > 0; in experiments At should be much smaller than the relaxation 
time of the system [2J| and, in the presence of colored noise, should also meet the condition At ^> r. 

The symbols in Fig. EJc) represent the experimental values of S(y) for various a and r; they clearly show that, 
for the system described by Eq. ([3]), S(y) is a constant that depends only on the intensity of the input noise <r, i.e. 
S(y) = ^cr 2 , and not on r. Fig. [2jd) shows the deterministic response G(y) [solid line] and the experimental values 
of D(y) [symbols]; the values of D(y) lay on G(y) independently of a and r. We note that the absence of dependence 
on r for both S(y) and D(y) demonstrates that a white noise is a good model for the colored driving noise used in 
our experiments, i.e. with r < 1.1 /is. 



III. SYSTEM WITH FEEDBACK 



Now we introduce a multiplicative feedback in the circuit as shown in Fig. 03a). This is achieved by multiplying 
the input noise by F{y). As shown in Fig. [3jb), F(y) increases linearly between — 80 mV and 160 mV and saturates 
to 0.2 V (IV) for y < — 80 mV (y > 160 mV). The details of the circuit with multiplicative feedback are given in the 
methods section. The relevant SDE is: 



dy t = -ky t dt + aF(y t )dW t , (6) 

which now requires an explicit specification of a in order to be well-defined. For the case of an electric circuit driven 
by a colored noise the Stratonovich convention holds, as is expected theoretically from the Wong-Zakai theorem [l?} 
and has been shown experimentally [l6|. In fact, we see that the Stratonovich integral also describes the system in 
our case. 

When r = 1.1 /is, differently from the case without feedback [Fig. OUb)], the average trajectories in Fig. [3fc) do 
not converge to y = 0, but to y = 50 mV. This shift of the equilibrium is a consequence of the non-uniformity of S(y) 
[Fig. 03d)] due to the presence of a multiplicative feedback. 

D{y) [symbols in Fig. 03 e )] is also altered as a consequence of the multiplicative noise. In particular, D(y) is now 
different from G{y) [solid line in Fig. 03c)]. The difference between the two is a noise- induced extra-drift 

AD{y) = D(y) - G(y), (7) 

which is represented by the symbols in Fig. EJf). We remark that S(y) is independent from the interpretation of the 
underlying SDE H- 

The relation between AD(y) and the variation of S(y), i.e. S'(y) = 9 J^' , becomes evident considering the good 
agreement between AD(y) and 0.5S'(y) [dashed line in Fig. EJf)]. The prefactor 0.5 corresponds to the a of the 
Stratonovich interpretation of the SDE ([6]), which permits us to make sense of the experimentally observed data. 

We can therefore define 

which in general may depend on the system under study fbH . [25| . 



IV. DEPENDENCE OF a ON t/5 



We now proceed to decrease r. Some samples of xt are shown in Figs. IUa)-(c): the oscillations become faster and 
wider as r decreases (t = 0.6, 0.2 and 0.1 [is for Figs. IUa), (b) and (c), respectively). We remark that the shorter the 
t, the more closely the conditions for the applicability of the Wong-Zakai theorem [ijj are met. One might expect 
that the circuit equation will follow the Stratonovich equation even more closely and, thus, we shall expect no change 
with respect to the situation illustrated in Fig. 03 However, as we can see in Figs. IUd)-(f), as r decreases, the 
equilibrium position of the system moves back towards y = 0. 

Clearly, this behavior does not depend on the feedback; in fact, F(y) is the same in all the cases, as evidenced by 
the fact that the experimental values of S(y) do not vary significantly [symbols in Fig. E3g)]. Instead, it depends on 
the fact that, as r decrease, D{y) [symbols in Fig. Eth)] tends to G(y) or, cquivalently, AD(y) [symbols in Fig. Efl^i)] 
tends to 0. Using Eq. and S'(y) [dashed line in Fig. |3Ji)]i it is possible to calculate a, which goes from 0.5 to as 
t decreases. Thus, the SDE ([6]) shifts from obeying the Stratonovich calculus (a = 0.5 for r = 1.1 /is) to obeying the 
Ito calculus (a = for r = 0.1 /is). As we have remarked in the introduction, such a Stratonovich-to-Ito transition 
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can have dramatic effect on the long time dynamics of the system, for example, altering the system's equilibria a s 
shown in Figs. 2Jd)-(f). 

The reason for this Stratonovich-to-Ito transition lies in the underlying dynamics of the system modeled by the 
SDE ([5]). For most real physical, chemical, biological and economic phenomena such microscopic dynamics are either 
too complex to be modeled or simply experimentally inaccessible. This justifies the need to resort to effective models, 
e.g. SDEs. For this work, however, we have chosen a model system, i.e. an electric circuit, that gives us complete 
access to the underlying dynamics. We are, therefore, able to track down the observed Stratonovich-to-Ito transition 
to the fact that the feedback is not instantaneous, but entails a delay. We measured the feedback delay in the circuit 
in Fig. [3{a) to be 8 — 0.4 zxs (see methods section). The dots in Fig. [5]represent a as a function of S/t. The transition 
occurs as r becomes similar to 8, i.e. S/t w 1. This can be qua litatively explained considering that, if 8 = 0, there is 
a correlation between the sign of x and the time-derivative of F(y), which is the underlying reason why the process 
converges to the Stratonovich solution [l7j ; however, if 8 3> r, this correlation disappears effectively randomizing the 
time-derivative of F(y) with respect to the sign of x and leading to a situation where the system loses its memory. 

In order to gain a more precise mathematical understanding of this Stratonovich-to-Ito transition, we consider the 
following family of delayed ODEs 

dy t = -ky t dt + <jF(y t _ s )xldt, (9) 

where x[ is a sufficiently regular noise with correlation time r and the feedback is delayed by 8. Studying the limits 
where <5, r — > under the condition S/t = constant, we recover the SDE ([5]) with 

8\ 0.5 . . 

;) " IT? (10) 

The details of this derivation are given in the methods section. Fig. [5] shows the agreement between Eq. (fT0|) [grey 
line] and the experimental data as a function of r with fixed 8 — 0.4 fxs [dots]. 

In order to verify the dependence of a on the ratio S/t, we performed some additional experiments keeping r = 0.4 /xs 
fixed and varying 8. For this purpose, we added a delay line in the feedback branch of the circuit so that we could 
adjust 5 = 0.9 to 5.4 /xs (see methods section). The resulting values of a are plotted in Fig. [5] as squares and are in 
good agreement with the theoretical prediction given by Eq. JTUJ). 



V. CONCLUSION 



Our results show that the intrinsic ambiguity in the models of physical, biological and economical phenomena 
using SDE with multiplicative noise can have concrete consequences. In particular, even if an SDE with a specified 
convention is given, such convention can vary as a function of the hidden underlying dynamics of the system and 
therefore as a function of the position on the parameter space where the system is operated. Notably, our result that 
a Stratonovich-to-Ito transition occurs if the delay in the feedback (8) is longer than the correlation time of the noise 
(t) has general applicability since instantaneous feedback and white noise arc only mathematical approximations. 
The possibility of such a shift and of its dramatic consequences should be recognized and accounted for in many 
cases where SDEs with multiplicative noise are routinely employed to predict the behavior and evolution of complex 
physical, chemical, biological and economic phenomena. 



Appendix A: RC Circuit 



The dynamical system employed in our experiments is an RC-electric circuit. A noisy signal x t , which is generated 
by a function wave generator (Agilent 33250A) and pre-filtered by a low-pass filter to set the desired r, drives the 
RC series. The system's state yt is measured on the capacitor using a digital oscilloscope (Tektronix 5034B, 350 MHz 
bandwidth) at 10 6 sample/s. For the circuit with feedback, a high-speed low-noise analog multiplier (AD835) is 
employed to multiply Xt by the feedback signal (generated by amplifying y t and adding an offset) before applying it to 
the RC series. We measured the intrinsic delay of the circuit feedback branch (due to its finite bandwidth) applying 
a periodic deterministic signal and measuring the delay of the response. The additional delay line was realized by 
employing an analog variable delay amplifier (Ortcc 427A). 
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Appendix B: Derivation of Eq. (|10[) 



We study the solution of Eq. (|9|) taking the limit r, S — > while keeping 5/t = constant. In order to deal with a 
sufficiently regular process, we take x\ as a harmonic process (2(|, i.e. the stationary solution of the SDE 



dxj 
dz 



\z t dt 



-£z t dt- ^-xjdt 



dW t 



(Bl) 



where T, f2 and 7 are constants, is a Wiener process, and r is the correlation time for the Ornstein-Uhlenbeck 
process obtained taking the limit T, O 2 — > 00 while keeping jp- = 1. As r — > 0, the rescaled solution of Eq. (|B1[) 
converges to a white noise. 

In Eq. (j9]), we make the time substitution u = t — 5 and then write the equation in terms of the Wiener process V u 
defined as V u = Wu+s — Ws- Next, we expand about u to first order and rewrite the resulting equation as a first order 

system in y, v, x, and z, where v = \J\\fi'^ 1 - We then consider the backward Kolmogorov equation associated with 
the resulting SDE, which gives the equation for the transition density p(u, y, v, x, z, y' , v' ', x' , z 1 , u'). We can expand p 
in powers of the parameter y/r, i.e. p = po + V^Pi + T Pi + .... We use the standard homogenization method [13] to 
derive the backward Kolmogorov equation for po [28| . i.e. the equation for the the limiting transition density po as 
r, S — > with 5/t = constant. Finally, we take the limit r, fi 2 — > 00 while keeping the ratio ^ = 1. The resulting 
backward Kolgomorov equation is 



dpo 
du 



0.5 2 dF(y) 



9po + o 2 F 2 (y)a 2 po 
9y 2 9y 2 



and the associated (Ito) SDE is 



dy t = -ky t dt + ^La 2 F(y)^p^dt + aF{y)dW t . 
1 + 7 ay 

The equation for a [Eq. pH|) ] follows straightforwardly by comparison of Eq. (|B3|) and Eq. ©. 



(B2) 



(B3) 
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FIG. 1: Stochastic dynamical system without and with feedback, (a) Schematic of a stochastic dynamical system: the 
system's status y(t) evolves as the system is driven by a noisy input x(t). (b) Same system with feedback F(y): x(t) is now 
modulated by F(t) and y(t) is clearly affected. 
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FIG. 2: Stochastic dynamical system without feedback, (a) In our experiments, we employ a RC electric circuit driven 
by a noise xt\ the system's status yt effectively experiences a harmonic restoring G(y) = — ky with k = 1/RC. (b) Sample 
trajectory of yt (t = 1.1 fjs) with initial condition yo = — 250 mV (dashed line) and average of 1000 trajectories for various 
initial conditions (solid lines), (c) Diffusion S(y) and (d) drift D(y) of the system status for various intensities and correlation 
times (r) of the input noise. S(y) is proportional to the variance of the system state change [inset in (c)] and D(y) to its 
average [inset in (d)]. The solid line in (c) represents the harmonic restoring G(y). 
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FIG. 3: Stochastic dynamical system with feedback, (a) Schematic of a stochastical dynamical system with multiplicative 
feedback F(y): the driving noise x t (r = 1.1 fj,s) is multiplied by a function of the system status yt. (b) Nominal (dashed line) 
and experimentally measured (dots) feedback function used in our experiments, (c) Average of 1000 trajectories for various 
initial conditions; there is a clear shift of the equilibrium in comparison with the case without feedback [Fig. [He)], (d) Diffusion 
5(y) (dots) and (e) drift D(y) (dots) of the system status. In (e), the solid line represents the harmonic restoring G(y) and the 
dashed line G(y) + 0.55" (y). (f) Agreement between the noise-induced extra-drift AD(y) and 0.5S'(y). 




FIG. 4: Dependence on the noise correlation time r. (a-c) Samples of input noises Xt with r = 1.1, 0.6, 0.1s for 
respectively (a), (b), (c). (d-f) Average of 1000 trajectories for various initial conditions with r = 1.1, 0.6, 0.1s for respectively 
(d), (e), (f); there is a shift of the equilibrium towards y = 0. (g) Dissusion S(y). (h) Drift D(y) (dots), harmonic restoring 
G(y) (solid line) and G(y) + 0.55' (y) (dashed lines), (i) the ratio between the noise-induced extra-drift AD(y) and 0.55' (y) 
clearly varies as a function of r. 
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FIG. 5: Dependence of a on 8/r. a varies from 0.5 (Stratonovich integral) to (Ito integral) as 5/t increases. The solid 
line represents the results of the theory [Eq. (|10|l ]; the dots represent the values of a for fixed 8 — 0.4 fj,s and varying r [Fig. 
[4]; and the squares for fixed r = 0.4 ps and varying 8. 



